# Hybrid Architecture

Falcon-H1 is a causal decoder-only language model developed by TII with a hybrid Transformers+Mamba architecture, supporting English and multilingual tasks.

Falcon-H1 is an efficient hybrid architecture language model developed by TII, combining the strengths of Transformers and Mamba architectures, supporting English and multilingual tasks.

Hybrid depth estimation model developed by Intel, combining the advantages of convolutional neural networks and Transformer architecture

The Hybrid Vision Transformer (ViT) model combines convolutional networks and Transformer architectures for image classification tasks, excelling on ImageNet.

CvT-21 is an image classification model based on the Convolutional Vision Transformer architecture, pretrained on the ImageNet-1k dataset at a resolution of 384x384.

CvT-13 is a vision transformer model pre-trained on the ImageNet-1k dataset, improving the performance of traditional vision transformers by introducing convolutional operations.